What are Outcomes?

Outcomes allow the administration and faculty to track mastery in a course. Users can import Account, State, and Common Core Standards into an account and course.

00:09: Outcomes. Enables, the administration and faculty to track students progress 00:13: as measured by pedagogical goals or desired outcomes. 00:17: Assessments created to test student knowledge, or to require students, to demonstrate 00:21: a specific skill. Resulting from a learning activity can be aligned to learning outcomes 00:25: using rubrics, which can be used for grading simultaneously. 00:30: Grading student work, automatically collects and compiles data on student 00:34: progress for the outcomes. The data is available for reporting to 00:38: support teaching Improvement identify at risk students and support 00:42: the accreditation process. This unified streamlined 00:46: approach dramatically reduces the amount of work required to implement learning outcomes, 00:51: through the intelligent reuse of assessment, workflows in the grading process, 00:56: Use outcomes, too. Focus students attention on the most important 01:00: skills and activities in your course, find existing outcomes or create 01:04: new ones. Align, quizzes and assignments to different kinds of Mastery. 01:09: Run reports that the account level about student, artifacts of learning Mastery 01:13: assess student progress through calculation. 01:16: Methods track student progress on a learning outcome or overall in 01:20: the learning Mastery Gradebook. Align accreditation, or other core standards 01:24: to programs of study courses, or student assessments. 01:29: When users create an outcome, users can set one of four calculation 01:33: methods used for student mastery weighted average, decaying 01:38: average, n number of times, most recent score, and highest score. 01:43: Calculation methods are used in conjunction within the learning Mastery gradebook. 01:48: Calculation methods can be set. When creating custom course, outcomes, for 01:52: instructors are creating custom account outcomes for admins. 01:57: The weighted average calculation factors the average of all assessment items while 02:01: weighing the most recent current submission to any assignment associated 02:06: with this outcome at a higher percentage. 02:09: By default, the canvas weighted average is set at 65/35 02:13: meaning, the current item is weighted at 65% and 02:17: the average of all other user scores is weighted at 35%. 02:21: However, users can specify between 1% and 99% 02:25: for the current percentage and prior scores are weighted against the percentage 02:29: difference. Note that the average is rounded to the next two decimals, 02:34: if there is only one result, then the single score will be displayed For 02:39: example, a student has four aligned items with scores of four, three, 02:43: two, and five scores listed chronologically from oldest 02:47: to most recent. If the current item is set to be weighted at 65% 02:52: of Mastery, prior scores are weighted at 35%. 02:56: Current item score 5, average of Prior item, scores. 03:01: 4 plus 3. Plus 2 3 equals 3 calculated 03:05: score. 5.65 plus 3.35. 03:11: Equals 3.25 + 1.05 = 03:15: 4.3. 03:18: The decaying average calculation uses a formula to determine proficiency based 03:22: on students average scores giving more weight to the most recent scored. 03:27: To determine the weight given to the most recent score. 03:29: The formula uses a Decay rate. 03:32: The higher the formula is Decay rate the more heavily. 03:35: The most recent assessment is weighted By default the Decay 03:39: weight is set at 65%. However, you can adjust the 03:44: rate to any percentage between 50% and 99%. 03:48: But between two assessments, the most recent assessment gets 65% 03:52: weight and the first gets 35% For each additional 03:56: assessment, the sum of the previous score calculations Decay by an additional 04:01: 35%. For example, a student has scores 04:05: of one, two, three, four scores listed chronologically from 04:09: oldest to most recent, One times point. 04:12: Three five plus two times point six five equals 04:17: x times point three five. 04:20: Plus Three times. 04:22: 0.65 =. Why? Why times 35 04:26: plus 4 times, 0.65 equals 04:30: z? This being the current standard score 3.48. 04:36: The N number of times calculation requires a specific number of times that Mastery 04:41: must be met or exceeded, and the number of aligned items that must be completed for 04:45: calculation eligibility. Any scores that do not meet Mastery 04:49: or not part of the calculation? Users can specify between one 04:53: and 10 items required for Mastery. 04:56: For example, a student is required to achieve Mastery two times with 05:00: a Mastery score of 5. If the student has scores of one, three, 05:05: two, four, five, three and six, only 05:09: the scores of 5 and 6 would be part of the calculation. 05:13: Average score of eligible. Items 5 + 6 =, 11 05:17: calculated score. 11 halves equals 5.5. 05:23: The most recent score calculation, always selects the most recent score for all 05:27: assessment items. 05:30: The highest score calculation, always selects the highest score for all assessment 05:34: items. 05:36: To select the average score from all assessment items select the average 05:40: option. You can view an example of the average calculation in 05:44: the example section, 05:47: If the account in course, level outcome, Mastery skills. 05:50: Feature option is enabled for your account. You can set Mastery scales for 05:54: the entire account. 05:56: If the account in course, level outcome Mastery. 05:59: Scales feature option is enabled for your account. 06:01: You can set Mastery calculations for the entire account. 06:06: If the account in course, level outcome Mastery. 06:09: Scales feature option in the improved outcomes management feature option are 06:13: enabled for your account. The outcomes page displays an improved interface for 06:17: viewing and managing outcomes. 06:20: This guide covered outcomes.

Account or Course Outcomes

Outcomes enables the administration and faculty to track students’ progress as measured by pedagogical goals or desired outcomes.

Assessments created to test student knowledge or to require students to demonstrate a specific skill resulting from a learning activity can be aligned to learning outcomes using rubrics (which can be used for grading simultaneously).

Grading student work automatically collects and compiles data on student progress for the Outcomes. The data is available for reporting to support teaching improvement, identify at-risk students, and support the accreditation process. This unified, streamlined approach dramatically reduces the amount of work required to implement Learning Outcomes through the intelligent reuse of assessment workflows in the grading process.

When would I use Outcomes?

Use Outcomes to:

  • Focus students' attention on the most important skills and activities in your course (find existing outcomes or create new ones)
  • Align Quizzes and Assignments to different kinds of mastery
  • Run reports at the account-level about student artifacts of learning mastery
  • Assess student progress through calculation methods
  • Track student progress on a learning outcome or overall in the Learning Mastery Gradebook
  • Align accreditation or other core standards to programs of study, courses, or student assessments

Calculation Methods

When users create an outcome, users can set one of four calculation methods used for student mastery: Weighted Average, Decaying Average, n Number of Times, Most Recent Score, and Highest Score. Calculation methods are used in conjunction within the Learning Mastery Gradebook.

Calculation methods can be set when creating custom course outcomes (instructors) or creating custom account outcomes (admins).

Notes:

  • For new Outcomes created in the Canvas interface, the default calculation is Weighted Average unless changed to another calculation.
  • For new Outcomes created using the Outcomes API, the default calculation is set as Highest Score but can be modified with the appropriate parameters.
  • If a user imports an outcome but does not have permission to modify the calculation method, the calculation method cannot be changed.
  • Common Core outcomes are always calculated as Highest Score; however, the calculation method can be modified using the Outcomes API by any user with appropriate admin permissions.

Weighted Average

Weighted Average

The Weighted Average calculation factors the average of all assessment items while weighing the most recent (current) submission to any assignment associated with this outcome at a higher percentage.

By default, the Canvas weighted average is set at 65/35, meaning the current item is weighted at 65%, and the average of all other user scores is weighted at 35%. However, users can specify between 1% and 99% for the current percentage, and prior scores are weighted against the percentage difference. Note that the average is rounded to the next two decimals. If there is only one result, then the single score will be displayed.

For example, a student has four aligned items with scores of 4, 3, 2, and 5 (scores listed chronologically from oldest to most recent). If the current item is set to be weighted at 65% of mastery, prior scores are weighted at 35%:

  • Current item score: 5
  • Average of prior item scores: (4 + 3 + 2) / 3 = 3
  • Calculated score: 5 (.65) + 3 (.35) = 3.25 + 1.05 = 4.3

Decaying Average

Decaying Average

The Decaying Average calculation uses a formula to determine proficiency based on students' average scores, giving more weight to the most recent scored. To determine the weight given to the most recent score, the formula uses a decay rate. The higher the formula's decay rate, the more heavily the most recent assessment is weighted. 

By default, the decay weight is set at 65%. However, you can adjust the rate to any percentage between 50% and 99%. Between two assessments, the most recent assessment gets 65% weight and the first gets 35%. For each additional assessment, the sum of the previous score calculations decay by an additional 35%.

For example, a student has scores of 1, 2, 3, 4 (scores listed chronologically from oldest to most recent):

(1 × .35) + (2 × .65) = X

(X × .35) + (3 × .65) = Y

(Y × .35) + (4 × .65) = Z  (this being the current standard score; 3.48)

n Number of Times

n Number of Times

The n Number of Times calculation requires a specific number of times that mastery must be met or exceeded, and the number of aligned items that must be completed for calculation eligibility. Any scores that do not meet mastery are not part of the calculation.

Users can specify between 1 and 10 items required for mastery.

For example, a student is required to achieve mastery 2 times with a mastery score of 5. If the student has scores of 1, 3, 2, 4, 5, 3, and 6, only the scores of 5 and 6 would be part of the calculation.

  • Average score of eligible items: 5 + 6 = 11
  • Calculated score: 11 / 2 = 5.5

Most Recent Score

Most Recent Score

The Most Recent Score calculation always selects the most recent score for all assessment items.

Highest Score

Highest Score

The Highest Score calculation always selects the highest score for all assessment items.

Select Average

To select the average score from all assessment items, select the Average option [1].

You can view an example of the Average calculation in the Example section [2].

Note: Average is not a good fit for most outcomes-based or mastery-based learning use cases because students may need time to reach mastery of an outcome and early poorer performance can bring down an average.

Outcome Mastery Scales

Outcome Mastery Scales

If the Account and Course Level Outcome Mastery Scales feature option is enabled for your account, you can set mastery scales for the entire account.

Learn more about mastery scales in an account or in a course.

Outcome Mastery Calculations

Outcome Mastery Calculations

If the Account and Course Level Outcome Mastery Scales feature option is enabled for your account, you can set mastery calculations for the entire account.

Learn more about mastery calculations in an account or in a course.

Improved Outcomes Management

Improved Outcomes Management

If the Account and Course Level Outcome Mastery Scales feature option and the Improved Outcomes Management feature option are enabled for your account, the Outcomes page displays an improved interface for viewing and managing outcomes.

Learn more about the Improved Outcomes Management in an account or in a course.